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Abstract 

Let game B be Toral's cooperative Parrondo game with (one-dimensional) 
spatial dependence, parameterized by N > 3 and po , pi , p2 , Pa £ [0,1], and 
let game A be the special case po = Pi = P2 — Pa = 1/2. Let fig (resp., 
A*(i/2,i/2)) denote the mean profit per turn to the ensemble of N players 
always playing game B (resp., always playing the randomly mixed game 
(1/2)(A + _B)). In previous work we showed that, under certain conditions, 
both sequences converge and the limits can be expressed in terms of a 
parameterized spin system on the one-dimensional integer lattice. Of 
course one can get similar results for fj,^i /1 _^ corresponding to 7 A + (1 — 
■y)B for < 7 < 1. In this paper we replace the random mixture with the 
nonrandom periodic pattern A r B 3 , where r and s are positive integers. 
We show that, under certain conditions, fiy r s i , the mean profit per turn to 
the ensemble of N players repeatedly playing the pattern A r B s , converges 
to the same limit that fbfL 1 _ J - ) converges to, where 7 := r/(r + s). For a 
particular choice of the probability parameters, namely po = 1, pi = pi € 
(1/2, 1), and P3 = 0, we show that the Parrondo effect (i.e., fig < and 
Mjy.s] > 0) is present if and only if N is even, at least when 8 = 1. 
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1 Introduction 



In Toral's [10] cooperative Parrondo games, there are N > 3 players labeled 
from 1 to N and arranged in a circle in clockwise order. At each turn, one 
player is chosen at random to play. Call him player i. He plays either game 
A or game B. In game A he tosses a fair coin. In game B he tosses a p^-com 
(i.e., po is the probability of heads) if his neighbors i — 1 and i + 1 are both 
losers, a pi-coin if i — 1 is a loser and i + 1 is a winner, a p2-coin if i — 1 is a 
winner and i + 1 is a loser, and a p3-coin if * — 1 and i + 1 are both winners. 
(Because of the circular arrangement, player is player N and player N + 1 is 
player 1.) A player's status as winner or loser depends on the result of his most 
recent game. The player of either game wins one unit with heads and loses one 
unit with tails. Under these assumptions, the model has an integer parameter 
N > 3 and four probability parameters Po,Pi,P2,P3 € [0,1]- Game A is fair, 
so the games are said to exhibit the Parrondo effect if game B is losing or fair 
and the random mixture C := "/A + (1 — j)B (i.e., toss a 7-coin, playing game 
A if heads, game B if tails) or the nonrandom periodic pattern C := A r B s is 
winning. Toral used simulation to find a case (namely, N — 50, 100, or 200, 
Po = 1, pi = P2 = 4/25, and ps = 7/10) in which the Parrondo effect appears 
when 7 = 1/2 or r = s = 2, thereby providing a new example of Parrondo 's 
paradox (Harmer and Abbott [7], Abbott [1]). 

Ethier and Lee [5] studied the random mixture case with 7 = 1/2. In this 
paper we focus on the nonrandom pattern case. Denoting the mean profits per 
turn to the ensemble of N players by [iF j_ % and [i^. s i in the two cases of game 
C and by fig in the case of game B, it was shown in [5] that /i^ converges under 
certain conditions on the parameters, and that M(i/2 1/2) converges essentially 
always. The limits can be described in terms of a parameterized spin system 
on the one-dimensional integer lattice. Of course one can get similar results 
for fj,^ l <. for < 7 < 1. Here we show that A*jy s i converges, under certain 
conditions, to the same limit that [i¥ \—~\ converges to, where 7 := r/(r + s). 
A similar phenomenon is present in a nonspatial iV-player model of Toral [11], 
as shown in [3], although in that setting, fi¥ does not depend on N. 

Numerical studies [4, 6] suggest that Mr^ s i converges much more slowly than 
(i(L i_ 7 v For example, let us consider the special casepo = 1/10, Pi — P2 = 3/5, 
and P3 = 3/4. By N — 18 (the largest N for which computations have been 
done in the nonrandom-pattern case) , ^ matches its limiting value to only 
two significant digits. On the other hand, by N = 19 (the largest N for which 
computations have been done in the random-mixture case), fig has stabilized 
to four significant digits and ^(1/2 1/2) nas stabilized to 11 significant digits. 

As in [5], we consider separately a particular choice of the probability pa- 
rameters, namely po = 1, p\ = pi € (1/2,1), and p^ — 0. We show that the 
Parrondo effect (i.e., < and /lijy s i > 0) is present if and only if N is even, 
at least when s = 1. 

Section 2 describes the iV-player model and the associated discrete-time 
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Markov chain. Section 3 establishes a strong law of large numbers (SLLN) for 
the sequence of profits to the ensemble of N players playing the nonrandom 
pattern A r B s , giving several formulas for M1y, s ]' Section 4 treats the special 
case in which we can confirm the Parrondo effect for all even N > 4. Section 5 
introduces the related spin system and reviews its basic properties. Finally, 
Section 6 establishes our main result, the convergence of Mr^ s ] as N —> oo to a 
limit that can be expressed in terms of the spin system. 



2 The discrete-time Markov chain 

Let us define the Markov chain, introduced by Mihailovic and Rajkovic [9], 
that keeps track of the status (loser or winner, or 1) of each of the N players 
playing game B. It depends on an integer parameter N > 3 and four probability 
parameters poiPiiP2,P3 € [0, 1]. Its state space is the product space 



E := {x = (x 1 ,x 2) ...,x N ):x t £ {0, 1} for i = 1, . . . , N} = {0, 1} N 

with 2 N states. Let rrii(x) := 2x;_i + CEj+i, or, in other words, rrii(x) is the 
integer (0, 1, 2, or 3) whose binary representation is (ajj-i ^+1)2; of course, 
xq := xn and £jv+i := x\. Also, let x % be the element of E equal to x except 
at the ith component; for example, x 1 := (1 — x\, X2, £3, . . . ,xn). The one-step 
transition matrix Pb for this Markov chain has the form 

p b {x^):=\ n n \^ ^ = °< ; 1 V.,. v 

[N q mi ( x) h Xi = 1, 

P B (x,x) := iV _ M ^2 Q'm 4 (a>)+ J! PmiWli X 6 S ' 

i:a;i— i:Xi — l 

where g m := 1 — p m for m = 0, 1, 2, 3 and empty sums are 0, and Pb(x, y) = 
otherwise. 

Necessary and sufficient conditions on N > 3 and Po,Pi,P2,P3 € [0, 1] for the 
ergodicity of the Markov chain were given in [5]. (A Markov chain is ergodic if 
there is a unique stationary distribution and the distribution at time n converges 
to it as n — > 00, regardless of the initial distribution.) 

If po = pi = P2 = P3 = 1/2, then we denote Pb by Pa- Our main concern 
is with the nonrandom pattern of games A r B s for positive integers r and s, 
in which case the relevant Markov chain in E has one-step transition matrix 
P^Pb- Out first result shows that this chain is ergodic for all choices of the 
parameters. Actually, we need a slightly stronger result. 



Lemma 1. Let N > 3 and Po,Pi,P2tP3 G [0,1]- Fix r, s > 1 and put Pi := 
Pa 1 -f > B-F > A, ■ ■ • , P r ■— Pb^A' Pr+i '•= Pg 1 Pa_Pb , ■ ■ ■ , and P r+S := P A Pg. 
(These are the r + s cyclic permutations of P t a Pq.) 

(i) The Markov chain in E with one-step transition matrix P±, P 2 , . . . , or 
P r is irreducible and aperiodic. In particular, it is ergodic. 
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(ii) The Markov chain in E with one-step transition matrix P r +i, P r +2, 
. . . , or P r + S has the following behavior. There exists a (possibly empty) proper 
subset T C E such that T is transient and E — T is closed, irreducible, and 
aperiodic. In particular, the Markov chain is ergodic. In fact, the set T, which 
does not depend on r or s, can be specified as follows. 

(a) Ifp ,p 3 G (0,1), thenT = 0. 

(b) If po = 1 and pj, € (0, 1], then T = {0}, with one exception. If N is di- 
visible by 3 and (p ,Pi,P2,P3) = (1,0,0,1), then T — {0, Oil • • • Oil, 101 • • ■ 101, 
110- ■■ 110}. 

(c) If po — and pz G (0,1), then T = 0, with one exception. If N is 
divisible by 3 and pi = p 2 = I, then T = {001 • • • 001, 010 •• • 010, 100 •• • 100}. 

(d) If po G [0,1) and p 3 — 0, then T = {1}, with one exception. If N is 
divisible by 3 and ( P o,pi,p 2 ,p 3 ) = (0,1,1,0), then T = {001 • • • 001, 010 • • • 010, 
100- •• 100,1}. 

(e) If po € (0,1) and p 3 = 1, then T = 0, with one exception. If N is 
divisible by 3 and Pl = p 2 = 0, then T = {Oil • • • Oil, 101 •• • 101, 110 •■ ■ 110}. 

(f) If po = 1 and p 3 = 0, then T = {0, 1}. 

(g) Let po = and p% = 1 . If N is odd, then T = , and if N is even, then 
T = {01 ■ • • 01, 10 • • • 10}, with two exceptions. If pi = p 2 = 0, then T comprises 
all states in which Os occur as singletons and Is occur as singletons or pairs. If 
Pi = p 2 = 1, then T comprises all states in which Is occur as singletons and Os 
occur as singletons or pairs. 

Proof. We claim that it is enough for part (ii) to show that 

(1) Pb(x,x) > 0, cceE-T, 

(2) P B (x,y) = 0, a;eE, yeT. 

We treat the case of P r +s, the cases of P r +i, ■ ■ ■ , Pr+s-i being similar. To 
see this, suppose x, y 6 E — T. Then there exist x = x , x\, . . . , x n -i, x n — 
y such that Xi £ E and P J 4(a; i _i, Xi) > for i = 1, 2, . . . , n because Pa is 
irreducible. We claim that be assumed to belong to E — T 

(see the paragraph following the next one). But then 

P r+s (xi- U Xi) > P A {x^ 1 ,x l )(l/2) r - 1 [P B {x l ,x l )] s > 

by (1) (and since Pa^i, X\) = 1/2), so E — T is irreducible for P r + S - Similarly, 
if x G E - T, 

Pr+s(x,x) > (l/2) r [P B (x,x)] S > 

by (1), so E — T is also aperiodic for P r + S . By (2) and the fact that the final 
factor in P r + S is P B , E — T is closed and states in T are transient. 

We claim that (1) and (2) are also sufficient for part (i). We treat the case 
of P r , the cases of Pi, . . . , P r _i being similar. To see this, suppose x, y 6 E. 
By (2), there exists x' 6 E — T such that P B {x,x') > 0. Hence 

P r (x,x') > P B {x,x')[P B (x',x')} s - 1 {l/2) r > 0. 
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Also, because of the simple form that T has, there exists y' € E — T such 
that PA(y\y) > 0. Finally, as in the preceding paragraph, there exist x' = 
x , x\, . . . , x n -\ = y' , x n = y such that XjeS-T and PA{xi-\, Xi) > for 
i = 1, 2, . . . , n — 1. We then get 

P r (»i-i,aJi) > [PB(a;»-i,x i _ 1 )] s (l/2) r - 1 P A (x i _ 1 , :Ei ) > 

for z = 1, 2, . . . , n, so P r is irreducible. Finally, for the aperiodicity of P r , we 
observe that, if x e E — T, 

P r ( : r, : E)>[P B ( : r, : r)] s (l/2) r >0, 

and this suffices by irreducibility. 

There is a missing step in the first paragraph. Specifically, we must show 
that, given x,y e E — T, there exist a; = a; ,£Ci, • ■ ■ , x n -i,x n = y such that 
Xi e E — T and Pa(^i-i, > for i = 1, 2, . . . , n. In fact, we can choose 
n equal to the Hamming distance between x and y, d(x, y) := X^iLi I 2 -* — 
The justification for this requires a case-by-case analysis, but the idea is much 
the same in each case. Suppose T = {0}. Then y must have y k = 1 for some 
k E {1,2, . . . , N}. If x k = 1, then every Xi will have fcth component 1, hence 
will not be in T. If x k — 0, then let X\ = x k . Again, Xi will have fcth component 
equal to 1 for i — 1, . . . , n, hence will not be in T along with x by assumption. 

A similar argument works for T = {1}, so suppose T = {0,1}. Let k <G 
{1,2, . . . , N} be such that (y k ,y k+1 ) = (0, 1). If (x k ,x k +i) equals (0, 1), we are 
finished; if it equals (0,0) or (1,1), then x\ is x k or x k+1 as needed. Finally, 
if (x k ,x k+ i) = (1,0), then define X\ and X2 by flipping the bits at sites k and 
k + 1 in whichever order is necessary to avoid having X\ € T. It follows that 
x ,xi,. .. ,x n e E - T. 

Next, suppose N is even and T = {01 • • • 01, 10 • • • 10}. Given x, y e E — 
T, y must have two consecutive 0s or two consecutive Is; assume the former 
case, the latter case being symmetric. Then there exists k <E {1,2,..., N} such 
that {y kl y k +\) = (0,0). The argument is now completed as in the preceding 
paragraph. 

There are six other cases that must be considered (the various exceptional 
cases in the lemma). By symmetry, it is enough to consider the case T = 
{001 • • • 001, 010 •• • 010, 100 •• • 100}, the case where T is the union of the latter 
set and 1, and the case where T contains all vectors in which Is occur only 
as singletons and 0s occur only as singletons or pairs. We treat the first case, 
the other two being similar. Given x,y G E — T, y must have a segment of 
the form 000, 011, 101, 110, or 111. For example, in the first case, there is a 
k € {1,2, ... , N} such that (y k , yk+i, Vk+2) = (0, 0, 0). In any case, if x differs 
from y at none of these three sites, we are finished. If it differs at one, we flip 
the bit at that site to determine X\. If it differs at two, we flip the bits at these 
two sites to determine X\ and X2, the order chosen so as to avoid having x\ € T. 
If it differs at all three sites, we flip the bit at one of the three sites to determine 
Xi, the site chosen to avoid X\ € T. Then it differs at two of the sites, a case 
we have already treated. This completes the missing step. 
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It remains to show that (1) and (2) are satisfied by Pb- We consider (1) 
first. By virtue of 

P B {x,x) := N' 1 ! <?m I (x)+ ?WaoJ. 

i:Xi— i:Xi— 1 

property (1) holds if, for each x e E — T, at least one of the following holds: 
Po < 1 and x contains the segment 000; po > and x contains the segment 010; 
Pi < 1 and a; contains the segment 001; p\ > and cc contains the segment 011; 
p 2 < 1 and a; contains the segment 100; P2 > and x contains the segment 110; 
P3 < 1 and x contains the segment 101; P3 > and x contains the segment 111. 

(a) If x has three consecutive 0s or three consecutive Is, then po < 1 or 
P3 > suffice, so suppose not. Then x contains the pair 01. If 01 is part of 010 
or 101, then po > or P3 < 1 suffice, so we can assume that 01 is part of 0011, 
hence 100110. This suffices if p 2 < 1, Pi < 1, Pi > 0, or p 2 > 0, and at least 
two of these inequalities must hold. 

(b) If P3 < 1, then the argument is similar to that of (a), except x = is 
excluded but we cannot rule out three consecutive 0s. So 01 is part of 0011, 
hence part of 100 • • • 00110. The proof is otherwise unchanged. 

If p 3 = 1, then x = is excluded but we cannot rule out three consecutive 
0s. If x has three consecutive Is, then P3 > suffices, so suppose not. Then x 
contains the pair 01. If 01 is part of 010, then po > suffices. Hence we can 
assume it is part of 011, therefore 0110. We are finished if p% > or p 2 > 0, 
so suppose pi — p 2 = 0. If we exclude x of the form 011 • • • 011, 101 • • ■ 101, 
or 110- • • 110, then we have ruled out all possibilities (singleton Is and three 
or more consecutive Is are excluded, and two or more consecutive 0s can be 
excluded because p\ < 1 and p 2 < 1). 

(c) If x has three consecutive 0s or three consecutive Is, then po < 1 or 
P3 > suffice, so suppose not. Then x contains the pair 01. If 01 is part of 101, 
then P3 < 1 suffices, so suppose not. Then it is part of 001, therefore 1001. We 
are finished if p 2 < 1 or p\ < 1, so suppose p\ = p 2 = 1. If we exclude x of the 
form 001 •■ ■ 001, 010 ■• • 010, or 100 ■• • 100, we have ruled out all possibilities 
(singleton 0s and three or more consecutive 0s are excluded, and two or more 
consecutive Is can be excluded because p\ > and p 2 > 0). 

(d) and (e) These cases are symmetric with (b) and (c). 

(f) The argument is similar to that of (a), except x = and x = 1 are 
excluded but we cannot rule out three consecutive 0s or three consecutive Is. 
Then x contains the pair 01. If 01 is part of 010 or 101, then po > or P3 < 1 
suffice, so we can assume that 01 is part of 0011, hence 100 • • • 0011 • • • 10. This 
is similar to case (a). 

(g) If x has three consecutive 0s or three consecutive Is, then p < 1 or 
P3 > suffice. So suppose not. Then x contains the pair 01. Suppose it is part 
of 001 or 011. In the first case it is part of 1001. If this is part of 10011, then 
it suffices that p% < 1, pi < 1, or pi > 0, at least one of which must hold. If 
this is part of 11001, then it suffices that p<z > 0, p% < 1, or p\ < 1, at least 
one of which must hold. Therefore we can assume that 1001 is part of 010010. 
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This suffices if p 2 < 1 or pi < 1, but if pi = p 2 = 1, then we must rule out 
states in which Is occur as singletons and Os occur as singletons or pairs. If x 
is not of this form, then we can choose our initial 01 in such a way that it is 
not embedded in 010010. In the second case, in which 01 is part of 011, it is 
part of 0110. If this is part of 01100, then it suffices that p\ > 0, p 2 > 0, or 
P2 < 1, at least one of which must hold. If this is part of 00110, then it suffices 
that pi < 1, p\ > 0, or p 2 > 0, at least one of which must hold. Therefore we 
can assume that 0110 is part of 101101. This suffices if p\ > or p 2 > 0, but if 
Pi = Pi = 0, then we must rule out states in which 0s occur as singletons and 
Is occur as singletons or pairs. If x is not of this form, then we can choose our 
initial 01 in such a way that it is not embedded in 101101. Finally, the only 
other possibility is that 01 is part of 1010. Assuming x is not part of 01 • • • 01 
or 10 • • • 10 with N even, there must be a 01 that is not embedded in 1010. 
This finally proves (1), so we turn to (2), which is equivalent to 

P B (y,y) = 0, P B (y i ,y) = 0, y e T, i = 1,2, . . . ,N. 

If € T, then p = 1 and it suffices to note that P B (0, 0) = and P B (0 i , 0) = 
0. If 1 G T, then P3 — and it suffices to note that P B (1,1) = and 
P B (V, 1) = 0. If N is even and 01 • • • 01 G T, then p = and p 3 = 1 and 
it suffice to note that P B (01 ■ ■ ■ 01, 01 • • • 01) = and P B (01 • • • 01 1 , 01 • • • 01) = 
0. The same applies if N is even and 10 • • • 10 G T. If N is divisible by 
3 and 001 • • • 001 G T, then p = and pi = p 2 — 1 and it suffices to 
note that P B (001 • • • 001, 001 • ■ • 001) = and P B (001 ■ ■ • OOP, 001 • • • 001) = 
0. This also applies to rotations of 001 ••■001. If N is divisible by 3 and 
011 •••011 G T, then pi — p 2 = and pz = 1 and it suffices to note that 
Pb(011-- -011,011 •••011) = and P B (011 • • • 01T, 011 • • • 011) = 0. This also 
applies to rotations of 011 •••011. The only remaining cases are the excep- 
tional cases of part (g). If (po,Pi,P2,P3) — (0,0,0, 1) and if x has only single- 
ton 0s and singleton or paired Is, then P B (x,x) = and P B (x l ,x) = 0. If 
(P0)Pi)P2)P3) = (0, 1, 1, 1) and if x has only singleton or paired 0s and singleton 
Is, then P B (x,x) — and P B (x l ,x) =0. □ 

Lemma 2. Let G be a subgroup of the symmetric group Sn- Let P be the one- 
step transition matrix for a Markov chain in £ having a unique stationary distri- 
bution 7r. For x = [xi, . . . , xn) G £ and a G G, write x a := (x^m, . . . , a^ny)), 
and assume that 

(3) P(x a ,y a ) = P(x,y), aeG,x,yeJ:. 

Then n(x a ) = n(x) for all a G G and x G S. 

This lemma is from [4] , where it was shown to apply to P B when G is the sub- 
group of cyclic permutations (or rotations) of (1, 2, ... , N) and, if p\ = p%, when 
G is the subgroup generated by the cyclic permutations and the order-reversing 
permutation (rotations and/or reflections) of (1, 2, ... , N), the dihedral group of 
order 2N. It therefore also applies to Pa under the same conditions and hence, 
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for fixed r, s > 1, to each of the one-step transition matrices Pi, Pa, ... , P r + S 
of Lemma 1 under the same conditions. For this we need a simple observation. 
Let us define the stochastic matrix P with rows and columns indexed by E to 
be G-invariant if (3) holds. We notice that the class of G-invariant stochastic 
matrices is closed under matrix multiplication, for if _F\ and P 2 are G-invariant, 
then 

[P 1 P 2 ](x ry ,y cr ) = ^2P 1 (x a ,z)P 2 {z 7 y a ) = Pi{x a , z a )P 2 (z a ,y a ) 

zeS zGE 

= ^P 1 (x,z)P 2 0,y) = [PiP 2 ](x,y). 

zGS 

for all a G G and x, y e S. 

For example, with 7r being the unique stationary distribution of P^P B , the 
lemma applies to nP^P B , which is the unique stationary distribution of P r + V , 
for u = 0, 1, . . . , s— 1. We conclude that, if pi — p 2 , then the 1, 3 two-dimensional 
marginals of ttP^P b satisfy 

(4) [7rPlP^] 1 , 3 (0,l) = [7rPM] 1 ,3(l,0), v = 0, 1, . . . , s - 1. 



3 SLLN 

We will need the following version of the strong law of large numbers from [2] . 

Theorem 3. Let Pa and Pb be one-step transition matrices for Markov chains 
in a finite state space T,q. Fix r, s > 1. Assume that P := P r A P B , as well as 
all cyclic permutations of P^Pg, are ergodic, and let the row vector tt be the 
unique stationary distribution of P. Given a real-valued function w on Eo x ^o, 
define the payoff matrix W := (w(i, j))i,je"S - Define Pa '■= Pa ° W and 
Pb '■= Pb ° W , where o denotes the Hadamard (entrywise) product, and put 

r—l s—1 
u=Q v=0 

where 1 denotes a column vector of Is with entries indexed by Y.q. Let {X„}„>o 
be a nonhomogeneous Markov chain in S with one-step transition matrices 
Pa, ■ ■ ■ ,Pa (r times), P B , ■ ■ ■ , Pb (s times), P A , ■ ■ . ,Pa (r times), P B ,...,P B 
(s times), and so on, and let the initial distribution be arbitrary. For each n > 1, 

define £„ := w(X n -i, X n ) and S„ := £i H h^n- Then lim^oo n~ 1 S n = /X[ riS ] 

a.s. 

Remark. Under an additional assumption there is also a central limit theorem. 

Theorem 3 applies not to Pa and Pb of Section 2 but to analogous one-step 
transition matrices on a slightly more informative state space. The new state 
space is E* := E x {1, 2, . . . , TV} and the process is in state (a;, i) if x describes 



1 

11 r + s 
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the status of each player and i is the next player to play. Given N > 3 and 
Po,Pi,P2,P3 G [0, 1], we define P B by 



P B ((x,i),(x\j)) 



N 1 p mi ( x ) if Xi = 0, 
N^QmtW if a;* = 1, 



B 



((x.o.c^i)) : = r . 9m ^ 



if a;^ = 0, 
if Xi = 1, 



for all (jc, i) € £* and j = 1, 2, . . . , N, where q m := 1 — p m for m = 0, 1, 2, 3, 
and P B ((x, i), (y,j)) — otherwise. 

We further define PjJ to be P B with p = Pi = P2 = P3 = 1/2. 

Lemma 4. Lei TV > 3 and Po,Pi,P2,Pz € [0,1]. -Fke r,s > 1 and pwi P* := 

(Pji)r-i(p.)-p. j . . . , p; := {p* B y(p* A y, p* +1 : = (p B y-\Pzyp*, ..., an d 

Pr+ S '■= (PaY (PbY ■ (These are the r + s cyclic permutations of (P£) r (PbY ■ ) 

(i) The Markov chain in E* with one-step transition matrix P* , P 2 *, . . . , or 
P* is irreducible and aperiodic. In particular, it is ergodic. 

(ii) The Markov chain in E* with one-step transition matrix P* +1 , -P r *+2; 
. . . , or P* +s has the following behavior. There exists a (possibly empty) proper 
subset T C £ such that T X {1,2, ... , N} is transient and (S — T) X {1, 2, . . . , N} 
is closed, irreducible, and aperiodic. In particular, the Markov chain is ergodic. 
In fact, the set T, which does not depend on r or s, is as in Lemma 1. 

Let tt* denote the unique stationary distribution for (P^Y (P B Y , and let tt 
denote the unique stationary distribution for P^P B . Then 

(5) 7v*(PXY(P B Y = *PaPb x uniform{l, 2, ... ,7V} 

for v = 0, 1, . . . , s — 1. Also, tt* = tt x uniform{l, 2, . . . , TV}. 

Proof. Let tt* be stationary for (P£) r (P B ) s . We will show that it has the form 
stated in the lemma. Let X* (0), X* (1), ... be a nonhomogeneous Markov chain 
in E* with transition matrices PJ,...,PJJ (r times), P B ,...,P B (s times), 
P|, ...,Pj[ (r times), P B , . . . ,P B (s times), and so on, and initial distribu- 
tion tt*. Then X*(r + s) has distribution TT*(PX) r (P B ) s = tt* . On the other 
hand, writing X*(n) =: (X(n),I(n)) for each n > 0, we claim that, for each 
n > 1, /(h) is independent of -2f(n) and is uniformjl, 2, . . . , N}, condition- 
ally on (X(n — l),I(n — 1)), hence also unconditionally. This follows from 
P B ((x,i),(x\j)) = N- l Ci(x) and P*((x,i), (x, j)) = AT l [l - <*(»)], where 
Ci(a;) := p mi {x) if = and Cj(a;) := q mi ( x ) if &i = 1 (and similarly for P£ 
but with po = Pi = P2 = = 1/2). Since J*C*(0) has the same distribution as 
X* (r + s), we find that I(n) is independent of X(n) and is uniform} 1, 2, . . . , iV} 
for each n > (not just n > 1). We next claim that X(0), X(l), ... is a nonho- 
mogeneous Markov chain in E with transition matrices P4, . . . , P4 (r times), 
Pb, . . . , Pg (s times), Pa, ■ ■ ■ , Pa (r times), Pb, ■ ■ ■ , Pb (s times), and so on, 
and initial distribution 7r, cc-marginal of tt* . The Markov property is essentially 
a consequence of identities such as 

P(X(r + s) = x l I X(r + s - 1) = x) 



9 



_ P(X(r + s) = x\X{r + a - 1) = x) 
~ P(X(r + s -l)=x) 

= P((X(r + s),I(r + a)) = {x\ ■), (X(r + s - l),I(r + s - 1)) = (x, Q) 
P((X(r + s-l),7(r + s-l)) = (x,-)) 

= P((X(r + a),I(r + a)) = (x\j), (X(r + s -l),I(r + a- 1)) = (x,i)) 
P((X(r + s-l),I(r + s- 1)) = (x, i)) 

= P((X(r + s),I(r + a)) = (x\j) \ (X(r + s - 1), I(r + s - 1)) = (x, »)) 

= P B ((x,i),(x i ,j)) 

= P B (x,x l ), 

where, for example, I(r + s) = ■ means that the value of I{r + s) is unspecified. 

Since X(r + s) has distribution -nP r A P B as well as distribution 7r, we see that 
7T is the unique stationary distribution for P r A P B , as assumed in the statement 
of the lemma. Finally, 7r*, being the distribution of X* (0) = (X(0),/(0)), must 
equal n x uniform{l,2, . . . , N}, and the last conclusion of the lemma follows. 
For v = 0,1,..., s - 1, (X(r + v),I{r + v)) has distribution n* (P* A ) r {P B ) V 
while X(r + v) has distribution ttP a P b , so by the independence result of the 
preceding paragraph, (5) follows. 

It remains to prove the assertions about P*, . . . , P^+s- Let us first treat the 
case of -P r * +S , the cases of P* +1 , . . . , P r * +S _! being similar. If i 6 {1,2,..., N} 
and (y,j) e T x {1, 2, . . . , N}, then P B ((y\i),(y,j)) = P B (y\y) = and 
P^((y,i),(y,j)) < P B {y,y) = 0, so for all (x,i) e £* and (y,j) e T x 
{1, 2, . . . , N}, P* +S ((x,i),(y,j)) = 0. This implies the transience of T x 
{1,2,..., N} and the closedness of (E - T) x {1,2,..., AT}. As for the irre- 
ducibility of (E — T) x {1, 2, . . . , AT}, let (a;,?) and (y,j) belong to this set. 
Let Xq := x and let x\ E E — T be such that P* +s ((xQ,i), (x±,k)) > for all 
k e {1,2,..., A^}. By the irreducibility of P r + S on E — T (Lemma 1), there 
exist a?2, . . . , x n — y such that xi e E — T, ^ acj, and P r+s (!Ei_i, x{) > 
for i = 2, . . . ,n. Then there also exist fci, . . . , fc n _i € {1,2,..., such that 
P* +s ((xi-i, h-i), (xi,ki)) > for I = 2, . . . ,n with fc„ := j. With fc : = *) this 
also holds for I = 1, so we have P r * +S ((a;, i), (y,j)) > 0. For the aperiodicity of 
(E — T) x {1,2,..., A 7 "}, we need only show that, for some (x, i) belonging to 
this set, P* +S ((x, i), (x,i)) > 0. Let x e E - T. Then P B (x,x) > 0, so there 
exists io G {1, 2, . . . , A 7 } such that P B ((x, i ), (x, i j) > 0. Hence 

P r * +S ((a;, i ), (as, i )) > [PJ((x, i ), (x, t ))} r [P B ((x, i ), (as, * ))] s > 0. 

Finally, we treat the case of P r *, the cases of P*, . . . ,P r *_i being similar. 
For irreducibility, let (x,i) and (y,j) belong to E*. Let x := x and let Xi 
be such that P*((x ,i),(x 1 ,k)) > for all k £ {1,2,..., N}. Then, by the 
irreducibility of P r (Lemma 1), there exist x%, X3, . . . , x n — y such that 
xi and P r (xi_i,X[) > for I — 2, . . . , n. Then there also exist fci, . . . , fc„-i G 
{1, 2, . . . , N} such that P*((a3;_i, (xi, ki)) > for I = 2, . . . , n with fc„ := 
j. With fc := i, this also holds for I = 1, so we have P*{{x, i), (y,j j) > 0. For 
aperiodicity, we need only show that, for some (x, i) £ E*, P*{{x, i), (x, i)) > 0. 
Let x £ E - T. Then the argument is as in the preceding paragraph. □ 
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Notice also that the profit corresponding to each nonzero entry of P§ is 
equal to ±1, so Theorem 3 applies and there are several formulas for the mean 
profit, as we now show. 

Theorem 5. Given r, s > 1, let ir be the unique stationary distribution for the 
one-step transition matrix P r A P B . Let {(X (n), I(n))} n > be a nonhomogeneous 
Markov chain in E* with one-step transition matrices P A ,...,P A (r times), 
Pg, . . . , P B (s times), PJ, . . . , P\ (r times), P B , . . . , P B (s times), and so on, 
and arbitrary initial distribution. Define 

U :=w((X(n-l),I(n-l)),(X(n),I(n))), n > 1, 

where the payoff function w is 1 for a win and — 1 for a loss, determined by 
whether the corresponding entry of P B is of the form N~ 1 p m or N~ 1 q m . Let 



S n := £i + • • • + Cn for each n > 1. Then n S n — > fi>y. s i a.s. asn-> oo, where 

thr — -~> **~ N 



as 



e mean profit s i can be expressed in terms of nP A P B 
I s ' 1 1 N 

( 6 ) = r— tEE^MW^E^w -im^ x) h 



r + s ^— ' N 

v=0x£T, i=l 

in terms of the 1,3 two-dimensional marginals of itP r A P B as 

^ s-l 1 1 

(7) Mjr, s ] = E! E! E^^^ 1 ' 3 ^' - Qlw+z), 

v=0 w=0 z=0 

or in terms of the one- dimensional marginals of ~nP\ and ttP a P b as 

■ r-l 



(8) /# ' 



r ' sl r + s 



52{[*PZ]iM-[*Pa\i(P)} 

s-l 

^{[TrP^Ml) - [nP^UO)} 



u=0 

s-l 



v=0 

In the special case s = 1, (8) takes the simpler form 

0) < 4] = N ll^% + y {^ p AW) - MSMO)}. 

Remark. Another formula for /i|^ s ], better suited to numerical computation, 
was given in [6]. 

Proof. Theorem 3 gives the SLLN with 

i sl 

l l [r,s] = — s 



x ^-^7r*(Pir(p^r^i, 



v=0 
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where Pg is Pg with each q m replaced by — q m and 1 is a column vector of Is 
indexed by £*; here we used P4I = 0. Since [Pgl](x,i) = p mi (x) ~Qmi(x)- this 
and (5) imply (6). 

Next, using (6) and the rotation invariance property (see Lemma 2 and the 
discussion following it), we have 



1 s-l x N 



s-l , iv 



ZjE^EE Y^[K P A P B]i-hi+l( W > z ){P2w+z - q2w+z) 

v=0 i=l w=0 z=0 
^ s-l 1 1 

~EE E[ 7rP A P s]i,3(w, Z)(p 2w+ z - q2w+z), 



v=0 w=0 z=0 

which is (7). In the second line, the 0,2 and N — 1,N + 1 marginals are the 
N, 2 and N — 1, 1 marginals. 

Next, turning to (8), we let {(X(n), I(n))}„ e z be a nonhomogeneous Markov 
chain in E* with time parameter ranging over Z, the set of integers, and 
with one-step transition matrices P| from (X(n),I(n)) if n (mod r + s) be- 
longs to {0,1,..., r — 1} and Pg from (X(n),I(n)) if n (mod r + s) be- 
longs to {r, r + 1, . . . , r + s — 1}. Assume that (X(0), 7(0)) has distribution 
TT x uniform{l, 2,...,N}. Then {(X((r + s)n + j),I((r + s)n + j))} ne z is a 
stationary sequence for each j € Z with -X"(j) having distribution, for j = 
0,l,...,r + s- 1, 

^ firPj if J£ {0,l,...,r-l}, 

|7rPJP^ r if j g {r,r + l,...,r + s- 1}. 

Therefore, 

7ri'(l) = 7^(l)=P(X 2 (j) = l) 

j+r+s 00 

= EI E p ( X2 H r + s )" +fc ) = 1 ' / H r + s ) n+A: - 1 ) = 2 > 

" =J+1 " =1 /(-(r + s)n + k)^2,..., I(j - 1) + 2) 

j+r+s 00 ^ _| ^ (r+s)ri+j-fc 

" " ' P(X a (-(r + s)n + fc) = l, 



fc=3+ln - 1 7(-(r + a)n + ife-l) = 2) 

j+r+s 00 , v (r+s)n+j-fe ^11 

= E Ef 1 -^) jvEE^K^w- 

where the last equality follows by conditioning on Xi(—(r + s)n + k — 1) and 
-^3(— ( r + s)n + fc— 1); here 7r^ r+s := 7rf 3 and p m (k) :— p m if A; — 1 (mod r + s) 
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belongs to {r, . . . , r + s — 1} and p m (k) := 1/2 otherwise. Using the fact that 

r+s-l j+r+s oo / ^ x (r+s)n+j-fe 

iV / AT 



3=0 k=j + l n=l v 7 

r+s-lr+s oo , s (r+s)n — i -, 



ivy iv 

j=0 f=l n=l x 7 
r+s (l-l/N) r + s - 1 r +s-l r + s 

^ g N [i - (i - § "Cj + = X>(0 

if a is periodic with period r + s, this implies that 

3=0 ' ' u=0 it>=0 z=0 

Therefore, (8) follows from (7). 

Finally, (9) follows by replacing the sum over j in (10) by the j = r term, 
assuming s = 1: 



2r+l oo , 1 x (r+l)n+i — fc -. 



N N 

k=r+l n=l x ' 

r+1 oo , s (r+l)n— i -, 

=EE - ^X'+o 



N N 

1=1 n=l x 7 

_ ^ (1 - i/tv)^ 1 -' 

- 2^N[i-{i-i/Ny+ 1 ] a{r+ ] 

= 1 fl-w a(r + 1) + f i ( x - w ) I 

JV[1 - (1 - 1/NY+ 1 } v^V^y N[l-(l-l/N) r + 1 ]J2 
if a(l) = • • ■ = a(r) = a(r + 2) = ■■■ = a{2r + 1) = 1/2. This implies that 

(1 — 1/A0 r 1 1 

7t[(1) - 7T[(0) = — — 1/jv w +11 El 7rP7 l]b3K^)(P2«,+^ -92«+ 2 ), 

and, combined with (7), this yields (9). □ 
We conclude with an application of the SLLN. 

Let us denote fig, the mean profit per turn to the ensemble of N players 
always playing game B, by /J-b(po,Pi,P2,P3) to emphasize its dependence on 
the parameter vector. As shown in [4], 

(11) (J>b(Po,Pi,P2,P3) = ~Hb 0?3, 52,51, ?o), 

where q m := 1 — p m for m = 0, 1, 2, 3. 
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Fix r, s > 1. Let us denote fiF., of Theorem 5 by fi^ s ](po,Pi,P2,P3)- A 
similar argument (see [6]) implies that 

(12) H* iS ](po,Pi,P2,Pa) = -Hfr ia ](qa,q2,qi,qo)- 

We say the Parrondo effect is present if fig < and fi^. s ^ > 0, whereas the 
anti-Parrondo effect is present if fig > and fi^ r s] < 0. Eqs. (11) and (12) imply 
that the Parrondo effect is present for the parameter vector (po>PiiP2,P3) if and 
only if the anti-Parrondo effect is present for the parameter vector (q^, q2,qi,qo). 
Since the transformation 

HP0,Pl,P2,Ps) ■= (1 -P3,1-P2,1-P1,1-Po) 

from (0, l) 4 to (0, l) 4 has Jacobian identically equal to 1, it follows that the "Par- 
rondo region" and the "anti-Parrondo region" have the same (four-dimensional) 
volume. 

Similarly, if we restrict attention to parameter vectors (po,Pi,P2,P3) with 
Pi = Pi-, then the Parrondo region and the anti-Parrondo region have the same 
(three-dimensional) volume. 



4 The case po = 1 ? Pz = 

Theorem 6. Let po = 1, p\ = p-x G (1/2, 1), andp 3 = 0. Let fig (resp., fJ>^. s j) 
denote the mean profit per turn to the ensemble of N > 3 players always playing 
game B (resp., repeatedly playing the nonrandom pattern [r, s], where r, s > X). 
Then fig = Q for all even N > A, fig 1 > for all odd N > 3, and fi^ rl] > 
for all N > 3 and r > 1 . In particular, the Parrondo effect is present for the 
nonrandom pattern [r, s] if and only if N is even, at least when s = 1 . 

Remark. We expect that the condition s = 1 is unnecessary for this result. 

Proof. The conclusions about game B are from [5]. 

Let 7r J 3 be the 1, 3 two-dimensional marginal of Tv r :— ttP^ when the prob- 
ability parameters are 1, p\, p\, and 0. Here 7r is the unique stationary distri- 
bution of P r A P B . We apply Theorem 5 twice. By (9) and (4), 



N[l - (1 - l/N) r+1 ] 
(r + l)(l- 1/Nf 



>r,3(i.i)-< 3 (o,o)]. 



By (7), (4), and the preceding formula, 

= (r + IJ-'KaCO, Q)(l) + 2^(0, l)(2 Pl - 1) + < 3 (1, 1)(-1)] 
_ 2(2 Pl -l) (1 - W , v 

- r+1 ^1,3(0,1) N[1 _ il _ 1/N y + lflr,lV 
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Therefore, 



,\ _ 2(2 Pl , (1 - W ' ' 



^ ~ r + 1 i, 1 + JV[1 - (1 - ) ^(0,1), 

and this is positive by the irreducibility of the Markov chain with transition 
matrix P r := PbP\ (Lemma 1) and the assumption that p\ > 1/2. □ 



5 A spin system 

As shown in [5], the discrete-time Markov chain for game B converges in dis- 
tribution, after rescaling its time parameter, to a spin system on the one- 
dimensional integer lattice Z. Let us recall the limiting process as described 
by its generator. Its state space is the product space 

{0, 1} Z := {x = (. . . , x-2, X-i,Xq,xi,X2, ...): Xi £ {0, 1} for all i € Z}. 

We will usually refer to Xi as the status (loser or winner, or 1) of player 
i; occasionally, it will be convenient to refer to it as the spin at site i. Let 
m,i(x) := 2xi-\ + Xi+\ as before but without the boundary conditions. Also, 
let x l be the element of {0, 1} Z equal to x except at the ith component; for 
example, as :=(... , X-2,X-i, 1 — Xq, x%,X2, ■ ■ ■)■ 

The generator depends on the four probability parameters Po-,Pi-,P2-,P3 G 
[0,1], and it has the form 

(13) {J? B f){x) :=Y,Ci(x)\f(x 1 )- f(*)] 

iez 

for functions / depending on only finitely many components, where the flip rates 
are given by 

(14) Ci (as) := < 



if Xi = 1, 



and q m := l—p m for m = 0, 1, 2, 3. It can be shown that the functions depending 
on only finitely many components form a core for the generator of the Feller 
semigroup associated with the process. 
For later use let us also define 

(15) (^ A f)(x):=J2llf(^)-f^)l 

iez 

which is just the special case of (13) with p$ = p\ = p2 = pz = 1/2. 

Next we would like to clarify the statement that this spin system is the 
limit in distribution of the iV-player chain for game B after an appropriate time 
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change. First, it is convenient to relabel the N players. Instead of labeling them 
from 1 to N, we label them from In to rN, where 

f-(JV-l)/2 if N is odd, , f(JV-l)/2 if N is odd, 

In := < , and rw := < 

1 -N/2 if N is even, 1 N/2 - 1 if N is even, 

with the understanding that players In and tn are nearest neighbors. The state 
space is 

Sat := {x = {xi N ,. . . , X-i, xq, Xi, . . . , x TN ) ■ x { G {0, 1} for i = l N ,... ,r N }. 

(This is what we previously called E but with the players relabeled. To avoid 
confusion, we make the dependence on N explicit in the notation.) We also 
speed up time in the iV-player model so that TV one-step transitions occur per 
unit of time. The resulting discrete generator has the form 

(jSf#/)(«) := NE[f(X N (l)) - f(x) | X N (0) = x] 

where Xi N -i := x rN and x rN+ i := xi N . Consequently, if we define (jy : 
{0,l} z by 

(16) (n(xi N , . . . , X rN 

)■■= (■•■,0,0 0,0,...), 

then Jz?^(/ o Cat) = (j2f B /) ° Cw for all a? G Eat and AT > + 4, where f(x) 
depends on x only through the 2K + 1 components Xi, —K < i < K. 

This shows that, if the spin system has a unique stationary distribution, 
then the unique stationary distribution of the iV-player Markov chain (assumed 
ergodic in the sense of Lemma 1 of [5]), converges to it in the topology of weak 
convergence (essentially Proposition 1.2.14 of Liggett [8]). Let us assume that 
the spin system has a unique stationary distribution 7r, and let us denote the 
unique stationary distribution of the iV-player Markov chain by ir N . (We pre- 
viously denoted the latter by 7r but now it is necessary to make the dependence 
on TV explicit. We do not use boldface for ir N or it because it is no longer useful 
or possible, respectively, to think of them as row vectors.) The above argument 
shows that tt 1 ^^ 1 => n. Let us denote their —1,1 two-dimensional marginals 
by (% N )-i : i and 7r_ 11 , so that (tt n )-i.i => tt-i,i and 

11 11 

w=0 z=0 w=0 2=0 

Hence fig, the mean profit per turn to the ensemble of -/V players always playing 
game B, converges as N — > oo to a limit that can be expressed in terms of the 
spin system. 

Under what conditions does the spin system have a unique stationary dis- 
tribution (equivalently, a unique invariant probability measure)? In [5] we gave 
sufficient conditions for the spin system to be ergodic, which means not only 
that there is a unique stationary distribution n but that the process at time t 
converges in distribution to 7r as t — > oo, regardless of the initial distribution. 
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Theorem 7. With Po,Pi,P2,P3 G [0, 1] , the spin system on Z with flip rates 
(14) is ergodic if at least one of the following four conditions is satisfied: 

(a) (basic estimate applies) 

max(|p — Pi |, \P2 -P3I) +max(|p -P2I, \pi - Ps\) < 1; 

(b) (attractiveness or repulsiveness applies) 

< min(p ,P3) < min(pi,p 2 ) < max(pi,p 2 ) < max(p ,p 3 ) < 1; 

(c) (coalescing duality applies) 

max(pi,p2,P3,Pi + P2 -Pz) ~Ps <Po/2 < min(Pi,P2,P 3 ,Pi + P2 -p 3 ); 

(d) (annihilating duality applies) 

Po,Pi,P2,p 3 G (2p- l,2p) n (0, 1), p := (p +pi +J5 2 +P3)/4. 

See [5] for further discussion. The following result is immediate. 

Theorem 8. Assume that (po,Pi,P2,P3) is such that we can define fig = 
Hb(po,Pi,P2,P3) for all N > 3 (this requires that the conditions for ergodic- 
ity in Lemma 1 of [5] are satisfied). Assume also that the spin system on Z 
with flip rates (14) is ergodic (see Theorem 7 for sufficient conditions) with 
unique stationary distribution it. Then limjv->.oo f-B = f-B, where 

1 1 

Pb ■= ^ y^7r_i,i(w, z)(p 2w+z - q2w+z)- 
w—0 z=0 

Let < 7 < 1 and assume that (po,pi,p2,P3) is such that we can define 

^(7,1-7) := ^(^0(7)^1(7)^2(7)^3(7)), 
for all N > 3, where 

(17) Pm(7)~ 7(1/2) + (l-7)Pm, m = 0,l,2,3, 



and that the spin system on Z with flip rates of the form (14) but with (po,Pi,P2j 
P3) replaced by (po(7),Pi(7),P2(7),P3(7)) is ergodic with unique stationary dis- 

N _ 
N^co M( 7 ,i- 7 ) — M(7,l-7)) 



tribution 7r 7 . Then lim/v^oo u^t, 1 . \ = Mf-v t— -vi, where 



1 1 

(18) M( 7 ,l-7) : = (1 - 7) X] X^ 71 " 7 )" 1 ' 1 ^' Z )(^2«,+2 - <72«,+z) 



<w=Q z =0 



We notice that condition (a) of Theorem 7 holds with (poj Pi 1 P2 1 P3) replaced 

by (po (7) ,pi (7)^2(7) ^3(7)) if 

max(|p -pi|, \p 2 -p 3 |) +max(|p -p 2 |, |pi -p 3 |) < 1/(1 - 7); 

this is automatic if 7 > 1/2. 

The special case of Theorem 8 in which 7 = 1/2 was included in [5]. 
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6 Convergence of means 

We turn to our main result, namely that limjv-»oo Mr^ s ] exists under certain 
conditions. 

Theorem 9. Fix r, s > 1 and put 7 := r/(r + s). Assume that the spin sys- 
tem on Z with flip rates of the form (14) but with (po,Pi,P2,J>3) replaced by 
(Po(l),Pi(l)iP2(l),P3('y)) (see (17)) is ergodic with unique stationary distribu- 
tion 7r 7 . Then limjy^oo t l \t s ] = M(7,l-7)> where /i( 7 j_ 7 ) is as in (18). 

Proof. Define Ov : £jv H> {0, 1} Z by (16). The main step is to show that the 
discrete generator ^u. s -\ , corresponding to the nonrandom pattern [r, s] (and 
with N games played per unit of time), satisfies 

(19) J2£ a] (/ o Cn) = [(r + s)-\r2> A + sJ? B )f] o ( N + O^- 1 ), 

uniformly over Sjv, for all / depending on only finitely many components, where 
where ££a and Jzfe are as in (15) and (13). Because the result is nonintuitive 
and the proof is technical, we treat the case r = s = 1 first. We hope this slight 
redundancy will improve clarity. 

In the case r = s = 1, the discrete generator has the form 

(^ A] f)(x) := f -f(x)}(P A P B )(x,z). 

z 

To evaluate this, we will need 

Pa{x, y) = l -8{x, y) + ~ E ^ »)' 

i 

Pb(v, z) = ^ - c,-(y)]<J(y, z) + i ]T 9 (y)5(^ , z), 

3 j 

where 6(x, y) is the Kronecker delta, which equals 1 if x = y and equals 
otherwise; the sums over i and j range over {In, ■ ■ ■ ,tn}] and Cj(y) is as in 
(14). This tells us that 

(P A P B )(x,z) =J2 p A(x,y)P B (y,z) 

v 

= ^ Et 1 - ^i + ^EEi 1 - c,^mx\ Z ) 

3 i 3 

+ ^ E c ; ow> *) + ^2 E E c ^ . *), 

where a;^ := (aj l ) J = (a;-') 1 , so our discrete generator reduces to 

&&i]f)(*) = ^EE^ <*(*')][/(**) - f( x )} 

i 3 
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+ *£c>)[/(^) -/(*)] 

3 

+ ^EE c ^ a;< )[/( a;<i )-/w]. 



Now let us restrict attention to those functions / that depend on only the 
coordinates x_(k-i), ■ ■ ■ , %k-i for some positive integer K. Then we can write 
the discrete generator as 



(^Vx*) = E Et 1 - ^w^) - /(*)] 

l»l<K-tfl<fr 

+ E E [i -<*(**)][/(*') -/(*)] 
i»i<jf iji>k 

+ i E -/(*)] 
+ 4^ E E 



\i\<K\j\<K 

\j E E <*(*')[/(*')-/(») 



4iV 

|i|<X|j|>AT 



^ E E ^[/O^') "/(*)]■ 



4iV 

\i\>K\j\<K 

Let us refer to the six terms of the expression on the right as terms 1-6. Terms 
2 and 5 combine to give 



4 ^ E E [/(*') - /(*)] = \ E N - { f +1) if(*i - /(-)] 

|*|<A-|j|>Jf \i\<K 



4 

|i|<K 



Term 3 is constant and term 6 simplifies to 

4 "5v E E c j (x i )[f(xi)-f(x)} = ^ ]T ^ Cj .(x)[/(^)-/(*) 

|i|>/f|j|<K |»|>A-|j|<Jf 

AT - (2if +1) 



4iV 



2 Cj (x)[/^)-/(x)] 



= 7 E cjfrM**) -fW+OiN- 1 ) 



4 

|j|<* 

because Cj{x l ) = Cj(x) if \i\ > K and \j\ < K, with a possible exception 
when |i| = K + 1, |j| = if, and i and j have the same sign, in which case 
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ffr-*) — f(x) = 0. Finally, terms 1 and 4 are 0(N 1 ), so we conclude that 



\j\<K 



(■&",i]f)(*) = E ( -+ l -c 3 {x))[ffr)- f{x)] + 0{N^) 



4 2 



1 1 



£ 7 + o c i(^) [/(^') ~ /(*)] + O^- 1 ) 



4 2 

= h& A f + Jgffl/)(Cjv(x)) + o^- 1 ), 

which leads to (19) with r = s = 1. 

The general case should now be easier to follow. 1 Given r, s > 1, we evaluate 



[PIPg](x ,x r+s 



sci,...,a; r +s— i ti— 1 u= r+1 



- n i 

Ci,...,X r -\- s -i U—l L 2 U 

r+s r 1 



^ £ £ £ n s ( x n-i^u) 

Ac{l,...,r) flC{r+l,...,r+«} xi,...,!B r + s _i u£i c 



u£B c 



- y — 

AC{1 r} 

£ £ £ n i 1 ~ °iv{ x v-i)] n ^c^-i' 



2< jy|A|+s 

Ac{l,...,r) BC{r+l,..,r+s) Xi,...,sc r+S _i 



1 r — 



2' ^y|A|+s 

Ac{l,...,r) BC{r+l,...,r+s} i u :ueAu{r+l,...,r+s} 



n 



{)„:t«eAUB,io<i)} 



{i w :w£ AVJB ,w <v} 




»eB c 



v£B 



s( Uv.veAuB} , 



x By convention, FIlLi a s^> equals {a\a,2 ■ ■ ■ a n )b, not (aia2 ■ ■ ■ a n )b n . 
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here A c := {1, . . . ,r} - A and B c := {r + 1, . . . , r + s} - B; also, x { ^ :veAuB} , 
for example, denotes Xq with the spin flipped at each site i v with v € AUB; 
these site labels are not necessarily distinct, so if there are multiple flips at a 
single site, only the parity of the number of flips is relevant. 

With fix) depending only on x_ik-i)i ■ ■ ■ i x K-i f° r some positive integer 
K, this leads to 

&£ t] f)(x ) = ^ E \K*r+.) - f(x )][P r A P^](x ,X r+s ) 

X r+ a 

Ac{l,...,r) Bc{r+1 r+j} i„:ue4u{r+l,...,r+s} 

n [i c l „(4 i ™ :iueAus ' u,< ^ } )] n Cl „(4^ :t ° eAus ^ <w} ) 

tiG_B c vEB 

■[/Oo )-/(*o)]- 
Now, with error at most 0(7V _1 ), we can replace Y^i u :ueAu{r+i,...,r+s} ^ 

(2D EE E 

ueA \i u \<K \iz\>K:zeAu{r+l,...,r+s},z^u 

+ E E E 

ti£-B |i„|<if |i z |>_fS":z6Au{r+l,...,r+s},z^M 

The justification is that each sum ^\ can be written as \<K^~^2\i \>ki 
resulting in 2'' 4 ' +s multiple sums. But each of those multiple sums with two or 
more sums of the form Yl\i u \<K contributes 0(iV _1 ), and those with no sums 
of the form Yl\i u \<Ki wnere u £ Ai) B, are 0. 

But before evaluating the result, let us make one more simplification. We 
replace the argument of Ci v in (20) by just Xq. Here the justification is that 
d^(xQ lu " weAuB ' w<v ^) — Cjjxo) for all but at most 3(r + s) of the N possible 
values of i v (namely, i w — 1, i w , i w + 1 for w — 1 , 2, . . . , r + s) , hence the approxi- 
mation introduces an error that is 0{N^ r ). The result is that a T,f){xo) can 
be written as the sum of two terms corresponding to the two multiple sums in 

(21) , plus OiN- 1 ). 

The term corresponding to the first multiple sum in (21) is, up to 0(A^ _1 ), 

( 22 ) tt^f E N^-s E E E 

Ac{l,...,r) BC{r+l,.,r+s) ueA \i u \<K 

H[i-c lv (x )}Y[c^(x ). 

\i z \>K:z£Au{r+l,...,r+s},z^u v£B c v£B 

Now since 

r+s 

e n t 1 ~ ^.^o)] n c i*( x o) = yi { i ~ c iA x o)+c iv (x Q )}=i 

BC{r+l,...,r+s}»6-B c v£B v=r+l 
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and since 

Ac{l,...,r} fe=0 v 7 



(22) becomes, up to 0(A^ _1 ), 



£ \\f«) - f(*0)] = -?—(J?Af)((N(x )). 



r + s ^ 2 1 v v /J r + s 

|i|<K 

The term corresponding to the second multiple sum in (21) is, up to 0(N~ 1 ), 

( 23 ) ^- s Yr E a^ti E E E 

Ac{l,...,r) Bc{r+1 r+s} h£B |t«|<ft 

|i 15 |>K:z£AU{r+l,...,r+s},Z7S« t>G-B c v£B 

Now 

r+s 

E E=E E - 

BC{r+l,...,r+s) uG-B ll=r+l BC{r+l,...,r+s}:uEB 

so (23) becomes 

1 1 r+s 

E E E ^wi/w)-/^)] 

Ac{l,..,r) u=r+l \i u \<K 

E E 

|-i»|>Jf :2gAu{r+l r+s},2#« BC{r+l,...,r+s}:u€B 

JJ [1- C iv (x )] Y[ °iv( x o) 
v£B" vEB-{u} 

u=r+l \i u \<K 

= -^-(jSk/XC^xo)) + o^- 1 ). 

r + s 

Let us replace / by / o £jv, where / 6 C({0, 1} Z ) and /(x) depends on 
only the components x_rK-i)> ■ ■ ■ > x K-i- We conclude that (19) holds, uni- 
formly over Sjy, which ensures that the unique stationary distribution tt n of 
P t a Pq converges weakly to the unique stationary distribution 7r r /( r+s ) of the 
spin system with generator J£b but with (pg ,pi,P2,P3) replaced by (po (l) > Pi (l) > 
P2 (7) 1^3(7)) 1 where 7 := r/(r + s), provided ergodicity holds for the limiting 
spin system. 

The mean profit per turn to the ensemble of N players playing the nonran- 
dom periodic pattern A r B a is, according to Theorem 5, 

1 ^ 1 N 

(24) < s] = — E E [^mn^ E^w - 

n=l)i£S i=l 
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Now term v of the sum in (24) can be expressed as 

K N (x Q )[P^P£}{x ,x)—Y^lPr-ii(x) -Qmi(x)] 

Xq.X I 

= ^12 nN ( x ^ 12 12 12 

x Ad{l,...,r} BC{r+l,..,,r+u}i s :u6iU{r+l,...,r+»} 



n [i- Cl j4 i - zeAuB ' z<w} )} n c tm (x^-- zeAuB ' z<w} ) 

wtB" w£B 



■-Yip 



so Ac{l,...,r} BC{r+l,...,r+u}i s :u6iU{r+l,...,r+»} 



weB" w£B I 

Jf 12* N ( X °)12b> m '(<Ba) " !m,(«o)] + C(A r " 1 ) 
so ! 
1 1 

U;=0 2=0 
1 1 

£ ^(W^)).!,!^, z)(p 2w+z - q 2w+z ) + 0(1). 



W=0 2=0 

Hence, using (17) with 7 := r j (r + s), we have 
1 1 

Mjr, s ] (1-7) Z 12(^-1 A W > Z )&ii»+* ~ l2w+z) = M( 7 ,l-7)' 
w=0 2=0 

as required. □ 
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